An Automated Approach for Specification-based Testing Using Business Goals and Plans

This paper presents a specification-based testing approach and implementation architecture that addresses several known challenges including false positives and domain knowledge errors. Our approach begins with a system goal graph consisting of high level business goals which are refined to operational goals, and plans that describe how to strategically achieve these goals. Along the goal refinement process business rules can be derived and/or used for constructing plans. Source code is annotated with goals and events and precompiled to emit those at run time. Plans are automatically translated into a rule-based recognizer. An oracle is produced from the preand post-conditions associated with the plan’s goals. When the program is executed, goals and events are emitted and automatically tested against plans and oracles. The concept is demonstrated for a small example and a larger publicly available case study in which we found a mismatch between stated requirements and actual program behavior.